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procedure  with  national-level,  monthly  data  for  the  period  January  1979  to  May  1985. 
Explanatory  factors  include  relative  military  pay,  unenploym&it,  recruiters,  goals, 
GI  Bill  benefits,  seasonality,  and  numerous  policies.  In  out-of-sample  testing,  the 
models  forecast  with  97  or  greater  percent  accuracy  over  a  12-month  pei;iod. 

-  '  -  -  /  h 'U  c  ;i- yfC knOc  ^  c  L 

.  The  forecasting  accuracy  of  the  enlistment  models  is  reduced  vdioi  a'  new  program 
or  policy  changes  relationships  in  the  market  structure,  ^search  on  alternative 
methods  of  remediating  forecasting  errors  caused  by  such  "regime  change"  indicates 
that  it  is  possible  to  regain,  within  three  to  six  mexiths,  the  level  of  forecasting 
accuracy  which  existed  prior  to  the  regime  change. 

>An  unemployment  forecasting  model  has  been  developed  for-the'lS^^ich  is  the 
function  of  15  leading  economic  indicators,  fr>ror»art-e  «-ho  im^pwpinyTnppf 

rat»-for  males-and  females -Itf^years^'and'over.  It  is  a  regression  model  with  an  ABMA 
error  structure,  and  is  estimated  with  national  monthly  data  from  Blay  1972  to  ^ril 
1984.  In  out-of-sanple  forecasting  tests  the  model  quite  successfully  predicts 
iiiininent  turning  points  several  months  in  advance  of  occurence.  Hie  model's 
forecasts  are  relatively  accurate,  and  are  used  by  the  ENS  as  a  variable  in 
forecasting  enlistmaits. 


The  Recruitmoit  BNS  was  inplemented  originally  in  a  mainframe  environment  using 
TSO  and  SAS.  In  Phase  II  the  entire  range  of  automated  tasks  —  database 
management,  statistical  procedures,  and  tabular  and  graphic  generation  —  are 
acconplished  by  a  standard  microconputer  gystan,  the  IBM  PC  XT  and  its  peripherals, 
using  comnercially  available  software  packages.-^  Inplementation-on  a  readily 
accessible  microconputer  substantially  reduces  the -costs  of  operating  and  modifying 
the  system. 


The  results  of  the  study  indicate  that  the  Recruitment  EMS  can  be  used  as  a 
valuable  source  of  credible  and  timely  information  for  evaluating  the  near-term 
status  of  the  recruiting  market. 
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EXECUTIVE  SUMMARY 
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RECRUITMENT  EARLY  WARNING  SYSTEM 


VOLUME  II:  SYSTEM  DOCUMQITATION  AND  USERS'  MANUAL 
FOR  THE  AUTOMATED  EARLY  WARNING  SYSTEM 


IHE  RECRUITMENT  EARLY  WARNING  SYSTEM 
PHASE  II  FINAL  REPORT 

BfflfamS  SUMMARY 

Xbs  Problem 

An  enlistment  shortfall  occurs  when  a  Service  cannot  meet  its 
recruitment  goals  in  terms  of  the  quantity  or  quality  of  accessions.  All 
four  Services  experienced  serious  recruiting  difficulties  or  actual 
shortfalls  in  FY  1978-79,  when  the  personnel  management  system  failed  to 
recognize  and  respond  to  declines  in  enlistment  supply.  This  study  is 
concerned  with  preventing  a  r^at  of  the  FY  1978-79  recruiting 
experience. 

Declines  in  unemployment,  relative  military  pay,  and  GI  Bill 
benefits,  precipitated  declines  in  enlistment  supply  beginning  in  FY 
1977.  The  declines  in  suK>ly  were  masked  somewhat  by  a  misnorming  of  the 
ASVAB,  the  qualification  test  given  to  applicants;  it  appeared  to 
managers  that  high-quality  enlistment  supply  was  relatively  fixed  when  it 
was,  in  fact,  declining  sharply.  The  Services'  Recruiting  Commands  first 
recognized  recruiting  problems  in  FY  1978.  However,  they  had  difficulty 
in  ccanvincing  their  own  Services  that  shortfalls  were  imminent.  Credible 
information  on  recruiting  market  trends  was  unavailable,  and  requests  for 
additional  resources  were  met  with  distrust  as  a  result  of  the 
gamesmanship  prevalent  in  the  <^ration  of  the  Planning,  Programming,  and 
Budgeting  System  (PPBS) .  It  was  not  until  FY  1979  that  the  Recruiting 
Conmands  could  convince  the  Services  and  DOD  that  more  resources  were 
needed. 


It  tcx)k  two  years  from  the  time  difficulties  began,  in  FY  1978, 
before  the  PPBS  first  responded  by  adding  recruiters,  in  FY  1980.  Later, 
in  FY  1981  and  in  FY  1982,  military  pay  was  increased.  In  FY  1982  GI 
Bill  benefits  for  Army  enlistments  were  sharply  increased  through  the 
Ultra  VEAP  Program.  But  in  FY  1982  the  econony,  a  major  factor  affecting 
enlistments,  had  turned  downward:  increases  in  uneirployment  and  slow 
growth  in  civilian  earnings  of  youth  caused  high-quality  enlistments  to 
increase  sharply  in  FY  1982-83. 

The  PPBS  solution  to  the  recruiting  problem  of  FY  1978-79  resulted 
in  the  creation  of  resource  surpluses  in  FY  1982-83.  The  planning  and 
budgeting  system  was  out-of-phase  with  the  recruiting  market  —  not  only 
in  FY  1978-82,  but  throughout  the  period  of  the  All  Volunteer  Force 
(AVF) .  Since  FY  1974,  at  least,  recruiting  resources  have  been  cut, 
while  civilian  unenployment  and  enlistments  declined.  Recruiting 
difficulties  have  been  exacerbated  rather  than  relieved  by  the  PPBS.  Why 
has  this  occurred? 

In  the  PPBS,  decisions  concerning  future  levels  of  recruiting 
resources  are  based  on  the  previous  year's  recruiting  experience,  which 
in  turn  depends  strongly  on  the  previous  year's  unemployment  level.  In 
projecting  enlistment  supply,  planners  implicitly  assume  that 
unenplpyment  will  be  more  or  less  constant  over  the  next  three  years. 
Unfortunately,  fluctuations  in  the  economy  play  havoc  with  this 
assumption.  Without  information  to  alert  planners  to  impending  short¬ 
term  changes  in  the  recruiting  market,  the  long-range  planning  system 
cannot  respcxid  adequately  to  recruiting  difficulties. 


II.  Project  Objectives 

I 

If  future  recruiting  difficulties  are  to  be  avoided,  the  personnel 
management  systan  of  DC®  and  the  Services  must  reduce  lags  in  the 
recognition  of  changes  in  the  recruiting  market.  To  do  so,  the  Services 
need  a  source  of  timely,  objective,  credible  forecasts  of  trends  in  the 
econony  and  in  enlistments.  The  Recruitment  Early  Warning  System  (EWS) 
has  been  developed  to  meet  this  need.  The  EWS  provides  monthly  forecasts 
of  high-quality  enlistments  and  unenployment  for  the  next  12  months. 
Forecasts  of  enlistments  are  conpared  with  goals  to  help  planners 
determine  whether  there  will  be  shortfalls  during  the  next  12  months. 

The  system  also  includes  other  data,  such  as  outside  forecasts  of 
unenployment,  that  are  useful  in  assessing  trends  in  the  recruiting 
market. 

III.  Review  ^  Phase  I 

The  Recruitment  EWS  study  began  in  September  1983.  The  first  year's 
work.  Phase  I  of  the  project,  was  devoted  to  a  feasibility  study.  A 
thorough  review  of  existing  early  warning  systems  and  forecasting 
methodologies  was  conducted.  Preliminary  forecasting  models  for 
enlistments  and  unenployment  were  developed,  as  well  as  a  precursory 
design  for  an  automated  recruitment  EWS.  Phase  I  concluded  that  the 
Recruitment  EWS  is  feasible,  and  recommended  continued  research. 

IV.  £ssults  £bas£  II  Research 


Phase  II  research  has  yielded  a  prototype  Recruitment  EWS  which 
produces  monthly  forecasts  of  enlistments  and  unenployment,  and  generates 
monthly  assessmait  reports  including  presentation-quality  grairf^s  and 
tables.  This  prototype  reflects  many  research  advances  made  in  Phase  II, 
both  in  econometric  methodology  and  microconputer  applicaticxi  systems 
develcpment. 


Research 


Enlistment 


Models 


The  success  of  the  recruitment  EWS  depends  critically  upon 
the  accuracy  of  the  forecasting  models  for  enlistments.  Models 
have  been  developed  for  two  cohorts  of  gross  contracts  for  each 
Service:  1-3A  NFS  male  HSDG's  and  seniors,  and  3B  NFS  male 
HSDG's  and  seniors,  A  regression  model  with  an  ARMA  error 
structure  is  used  for  all  Services  except  the  Navy.  The 
typical  model  is  estimated  using  a  non-linear,  least-squares 
estimation  procedure,  with  national-level,  monthly  data  for  the 
period  January  1979  to  May  1985.  Explanatory  factors  typically 
include  relative  military  pay,  unemployment,  recruiters,  goals, 
GI  Bill  benefits,  seasonality,  and  numerous  policies.  Values 
for  the  uneirployment  variable  are  the  unenployment  forecasts 
derived  from  EWS  unenployment  forecasting  models  described 
below.  Out-of-sanple  testing  of  the  enlistment  forecasts  have 
been  conducted  for  12-inonth  periods  in  FY  1984-85.  Test 
results  show  that  the  models  forecast  with  97  or  greater 
percent  accuracy  over  a  12-month  period. 


Error  Caused 


Change 


The  accuracy  of  the  forecasting  models  is  reduced  when  a 
new  program  or  policy,  introducted  by  the  Services,  changes 
relatioiships  in  the  market  structure.  A  major  research  effort 
was  undertaken  to  assess  alternative  methods  of  remediating 
forecasting  errors  that  occur  during  such  "regime  change."  The 
results  indicate  that  it  is  possible  to  regain,  within  three  to 
six  months,  the  level  of  forecasting  accuracy  which  existed 
prior  to  the  regime  change.  The  evidence  is  strong  that  good 
comnunication  between  the  Services  and  the  EWS  forecaster 
minimizes  the  time  required  to  take  regime  changes  into 
account. 


Accurate  unenployment  forecasts  are  an  inportant  conponent 
of  the  EWS.  Because  unenployment  has  fluctuated  in  a  cyclical 
fashion,  it  is  desirable  to  be  able  to  predict  turning  points. 
To  accurately  forecast  unenployment  one  year  ahead,  the 
prediction  of  turning  points  is  a  virtual  necessity.  To 
develop  this  capability,  the  study  team  has  constructed  ARMA 
regression  models  which  are  functions  of  15  leading  economic 
indicators.  The  unenployment  models  focus  on  the  unarployment 
rate  for  males  and  females  16  years  and  over.  They  are 
estimated  with  natiOTial-level  monthly  data  from  May  1972  to 
^ril  1984.  To  evaluate  their  validity,  out-of-sanple 
forecasting  tests  were  conducted  for  four  periods  during  which 
there  were  turning  points.  The  models  were  quite  successful  in 
predicting  —  several  months  before  the  actual  occurence  — 
that  turning  points  were  imminent,  and  they  were  moderately 
successful  in  pinpointing  the  exact  timing  of  turning  points. 

The  models  forecast  unenployment  with  a  satisfactory  level 
of  accuracy:  on  average,  the  forecasts  were  ^proximately 
within  half  a  point  of  the  actual  values.  The  success  of  the 
enlistment  forecasting  tests,  which  used  these  unenployment 
forecasts,  provides  evidence  that  the  EWS  unenployment 
forecasting  models  adequately  meet  the  needs  of  the  system. 

B.  autanatiOD  a£,  Recruitment  MS 

Rec«it  developments  in  microconputer  software -have  enabled  us 
to  implement  the  entire  Recruitment  EWS  oi  a  microconputer  systen. 
The  system  was  originally  inplemented  in  a  mainframe  environment 
using  TSO  and  SAS  to  produce  a  monthly  assessment  report.  Now, 
after  considerable  research,  the  entire  range  of  EWS  tasks  — 
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database  managentent ,  statistical  procedures r  and  tabular  and  graphic 
generation  —  are  accaiplished  by  a  standard  microcoiputer  system, 
the  IBM  PC  XT  and  its  peripherals,  using  commercially  available 
software  packages.  This  is  a  significant  achievement  which  has 
reduced  development  costs  and  will  reduce  operating  costs  in  the 
future. 

The  many  tasks  accomplished  by  the  EWS  have  been  integrated 
into  one  comprehensive,  yet  flexible,  system  design.  The  design  was 
developed  using  a  method  kncwn  as  "systematic  decomposition  of  a 
program  function."  With  this  method,  system  output  is  treated  as  a 
function  of  data  and  program  input.  A  complicated  program  function 
is  broken  down  into  simpler,  independent  components.  The  components 
fit  together  in  a  structure  that  matches  the  organization  of  the 
data  to  which  they  ajply  and  the  output  that  they  produce.  Careful 
and  methodical  system  design  had  made  possible  a  system  that  fully 
meets  the  original  design  deject ives,  yet  can  be  adapted  to  the 
demands  of  ongoing  research. 

The  automated  BWS  contains  an  historical  database  of  monthly 
observations  for  enlistment  contracts,  supply  factors,  leading 
economic  indicators,  and  policy  variables;  models  for  forecasting 
civilian  earnings,  unemployment  and  enlistments  by  cohort  for  each 
Service;  programs  to  perform  statistical  analyses;  and  procedures  to 
generate  tabular  and  graphic  output. 

The  system  is  highly  automated,  and  can  be  operated  with 
relatively  few  keyboard  commands.  Each  month  data  for  the  previous 
month  are  entered  into  a  program  which  automatically  updates  the 
entire  database.  When  the  update  procedure  is  completed,  a  single 
command  directs  the  system  to:  re-estimate  the  models;  forecast 
earnings,  unemployment,  and  enlistments  for  each  of  the  next  12 
months;  and  generate  report  files  which  provide  data  trends, 
summaries,  and  comparisons.  Historical  and  projected  enlistments 
are  compared  to  goals  over  the  past  two  and  current  fiscal  years  and 
the  next  12  months. 


6 


A  few  additional  canmands  direct  the  system  to  use  the  report 
files  in  producing  presentation-quality  tables  and  graphs.  These 
documents,  together  with  explanatory  material,  ccnprise  the  monthly 
Recruiting  Market  Assessment  Reports.  A  separate  report  is  produced 
for  each  Service.  The  reports  provide  decision  makers  with 
relevant,  timely,  and  reliable  information  on  the  current  and 
iirpending  status  of  the  recruiting  market. 


The  current  PPBS  is  well  suited  for  long-range  planning  in  a 
relatively  predictable  economic  environment.  Unfortunately,  the 
recruiting  market,  as  a  function  of  fluctuations  in  the  general  economy, 
is  UDpredictable.  Therefore,  it  is  very  difficult  to  forecast 
enlistments  two  to  three  years  in  the  future.  By  failing  to  accanodate 
to  this  reality,  the  PPBS  has  frequently  compounded  rather  than 
alleviated  recruiting  problems. 

If  future  recruiting  difficulties  are  to  be  minimized,  unforeseen 
changes  in  the  recruiting  market  nwst  be  recognized  more  quickly  by 
planning  and  budgeting  personnel.  The  Recruitment  EWS  provides  a  regular 
flow  of  information  for  helping  to  accaiplish  this  objective.  At  its 
current  level  of  development,  it  pranises  to  reduce  recognition  lags  of  a 
year  or  more  down  to  a  very  few  months.  With  further  improvements,  it 
could  provide  even  greater  assistance. 

For  the  Recruitment  EWS  to  be  successful,  there  must  be  effective 
communication  among  all  those  interested  in  recruiting  and  in  recruiting 
budgets.  To  disseminate  objective,  credible  information  it  will  oe 
necessary  for  the  Services  to  continue  their  expeditious  provision  of 
data  required  by  the  EWS  forecasters;  and  it  will  be  necessary  for  OSD  to 
distribute  the  monthly  Assessment  Reports,  generated  by  the  EWS,  to  all 
interested  parties  throughout  the  government. 


We  recomnend  full  implementation  of  the  Recruitment  EWS.  In  each  of 
the  last  six  months  of  the  study,  we  have  updated  the  system  and 
generated  prototype  Recruiting  Market  Assessment  Reports  which  have  been 
distributed  to  the  Services  and  OSD  for  conments.  We  recomnend  that 
monthly  updating  and  operation  of  the  system  continue,  and  that 
distribution  of  the  Assessment  Reports  be  expanded  to  include  interested 
officers  throughout  the  government. 
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Technology  Project  Manager 
Office  of  Naval  Research  (Code  270) 
Arlington,  VA  22217 


Department  of  Administrative  Sciences 
Naval  Postgraduate  School  (Code  54Ea) 
Monterey,  CA  93940 


Program  Director 

Manpower  Research  &  Advisory  Services 
Smithsonian  Institution 
801  North  Pitt  Street 
Alexandria,  VA  22314 


Director,  Naval  Research  Laboratory 
A3TO:  Code  2627 
Washingtcxi,  D.C.  20375 


Associate  Director  for  Life  Sciences 
Office  of  Naval  Research  (Code  440) 
Arlington,  VA  22217 


Leader,  Psychological  Sciences  Division 
Office  of  Naval  Research  (Code  442) 
Arlington,  VA  22217 


Engineering  Psychology  Group 
Office  of  Naval  Research  (Code  442EP) 
Arlington,  VA  22217 


Organizational  Effectiveness  Group 
Office  of  Naval  Research  (Code  4420E) 
Arlington,  VA  22217 


Personnel  and  Training  Group 
Office  of  Naval  Research  (Code  442FT) 
Arlington,  VA  22217 


Defense  Technical  Informaticm  Center 
DTIC/DDA-2 

Cameron  Station,  Building  5 
Alexandria,  VA  22314 


Director,  Research  &  Analysis  Division 
Navy  Recruiting  Command  (Code  22) 

4015  Wilson  Boulevard 
Arlington,  VA  22203 


